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A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 
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Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )E3 Responsive to communication(s) filed on 1 1 April 2005 . 
2a)D This action is FINAL. 2b)S This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 
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4) ^ Claim(s) 1-24 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) ^ Claim(s) 1-24 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing (s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 
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application from the International Bureau (PCT Rule 17.2(a)). 
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DETAILED ACTION 



Claim Rejections - 35 USC § 103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

Claims 1-7, 9, 11-13, 15, 17, 19, and 21-23 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over U.S. Patent No. 6,460,056 (Horii) and U.S. Patent No. 4,568,979 (Takagi). 

Referring to claims 1,2, 11, 17, and 22, Horii discloses in Figure 4 a system comprising 
speech input terminal [11], speech recognizer [13], speech dictionary [14], storage device [15], 
image dictionary storage [6], video output signal processor [24], image composer [23], and 
display [9]. In column 4: line 40 through column 5: line 23, Horii first explains that speech 
received at the input terminal [1 1] is recognized and stored at storage device [15]. A compressed 
image related to the recognized voice signal is then retrieved from the image dictionary storage 
[6] and transmitted to the image composer [23] through the video output signal processor [24]. 
In column 3: lines 11-17, Horii further explains that said image dictionary storage device 
comprises sign language images that may be obtained by adding motion to images produced by 
computer graphics (i.e. animation). Accordingly, a sign language animation model is inherently 
taught by Horii, because such would be required to relate the compressed sign language images 
to the recognized voice signals. In column 4: lines 14-21, Horii teaches that the recognized 
speech is first stored as character data. The inherent linking structure between said character 
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data and the sign language images thus corresponds to the claimed animation model parameters. 
An animation signal is then generated based on the parameters and used to render an animation 
image on a portion of a display as illustrated in Figure 5. Horii fails to disclose processing an 
audio/video signal to generate an isolated audio component signal. From Figure 4 though, it is 
clear that Horii's invention requires an isolated audio component signal at input terminal [11]. 
Horii further discloses in column 4: line 66 through column 5: line 7 that the invention could be 
operated using a television signal. A television broadcast signal, furthermore, includes both 
audio and video components. In any instance where a television broadcast signal is used, it 
would thus be necessary to separate the audio component so that it could properly be provided to 
input terminal [11]. Takagi teaches in column 2: lines 23-26 that an audio component can be 
separated from a video component in a television broadcast signal via a bandpass filter. 
Accordingly, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to improve Horii's invention by adding technology capable of processing an 
audio/video signal (e.g. a broadcast television signal) to generate an isolated audio component 
signal as taught by Takagi. It would have been advantageous to do so because the audio 
component is often combined with the video component, such as when the signal is a television 
broadcast signal. Regarding claims 2 and 11, Horii's invention must inherently isolate the 
speech component from the isolated audio component so that spoken words can be recognized 
and correlated with the associated sign language images. Regarding claims 17 and 22, Horii's 
invention must inherently comprise transmitters and receivers for transmitting and receiving the 
audio/video signals. 
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Referring to claims 3-5, Horii discloses in column 5: lines 14-23 that the audio/video 
signal could come from a television program, which is generally produced and transmitted from 
a location that is remote from the monitor. Horii, though, fails to disclose that the mapping step 
is performed remotely from the monitor, that the mapping step is performed proximate the 
transmitter, or a step of transmitting the animation model parameters to the monitor. The actual 
display, however, is typically only used to display an associated video signal. The physical 
location of Horii 's display is then by no means instrumental to the operation of the invention. 
The transmitting and mapping steps can be performed anywhere as long as the video signal can 
be routed back to the display for viewing. Furthermore, the examiner submits that it is 
notoriously well known in the state of the art that displays can be located remotely from where 
video signals and parameters are generated and transmitted. The examiner takes OFFICIAL 
NOTICE of this teaching. Accordingly, it would have been obvious to one of ordinary skill in 
the art at the time the invention was made to perform the mapping step remotely from the 
monitor/display and proximate the transmitter. Such an implementation would allow greater 
flexibility in deploying the invention in a variety of locations and environments. In this 
implementation, the animation model parameters would be transmitted to the monitor. 

Referring to claims 6, 12, and 19, Horii discloses in column 3: lines 7-17 that the image 
dictionary storage device [6] comprises a plurality of images related to character codes. Horii 
further explains in this section that the images can be obtained by adding motion to (animating) 
computer graphics. Accordingly, said images correspond to the claimed multiple character 
icons. 
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Referring to claims 7 and 13, Horii discloses in column 2: lines 57-61 that a keyboard 
(monitor control device) can be used to activate the processor. 

Referring to claim 9, 15, 21, and 23, Horii discloses in column 3: lines 7-17 that the 
image dictionary storage device [6] comprises a plurality of sign language images corresponding 
to related character codes. Horii further explains in column 4: lines 1-39 that spoken words from 
the speech component of the audio/video signal are correlated to the sign language symbols. 

Claims 8, 14, and 20 are rejected under 35 U.S.C. 103(a) as being unpatentable over U.S. 
Patent No. 6,460,056 (Horii) and U.S. Patent No. 4,568,979 (Takagi) as applied to claims 6, 12, 
and 19 above, and further in view of U.S. Patent No. 6,665,643 (Lande et al). 

Referring to claims 8, 14, and 20, Horii and Takagi fail to disclose displaying a character 
icon comprising a face with a mouth and animating the mouth to simulate speech corresponding 
to the speech component of the audio/video signal. Lande, though, discloses in column 2: lines 
31-67 a mechanism for animating a synthesized model of a human face, wherein the animation is 
driven by an audio signal. Ultimately, the synthesized model comprises a face with a mouth that 
is animated to correspond with the speech component of the audio signal. Accordingly, it would 
have been obvious to one of ordinary skill in the art at the time the invention was made to 
include an animated model of a face with a mouth as taught by Lande in the invention of Horii 
and Takagi. In instances wherein the primary video component fails to include images of the 
person from whom the speech is coming from, the animated model advantageously provides 
hearing disabled viewers with the option to lip read instead of interpreting hand gestures. 
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Claims 10, 16, 18, and 24 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
U.S. Patent No. 6,460,056 (Horii) and U.S. Patent No. 4,568,979 (Takagi) as applied to claims 1, 
11,17, and 22 above, and further in view of "Text-driven automatic frame generation using 
MPEG-4 synthetic/natural hybrid coding for 2-D head-and-shoulder scene". 

Referring to claims 10, 16, 18, and 24, Horii and Takagi fail to disclose generating 
animation model parameters via Synthetic Natural Hybrid Coding (SNHC). The "Text- 
driven. . ." reference, however, teaches that it is well known to use SNHC to generate animation 
parameters because it increases the intelligibility of non-verbal communication. Accordingly, it 
would have been obvious to one of ordinary skill in the art at the time the invention was made to 
use SNHC as taught by the "Text drive. . reference to generate the animation model parameters 
in combination with the teachings of Horii and Takagi. As suggested in the "Text drive. . ." 
reference, SNHC advantageously increases the intelligibility of non-verbal communication. 

Response to Arguments 
Applicant's arguments with respect to claims 1-24 have been considered but are moot in 
view of the new ground(s) of rejection. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Brian J. Detwiler whose telephone number is 571-272-4049. The 
examiner can normally be reached on Mon-Thu 8-5:30 and alternating Fridays 8-4:30. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John W. Cabeca can be reached on 571-272-4048. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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